AD-AU49  424 


ONCLAbSIFIED 


WISCONSIN  ONIV  MADISON  MATHEMATICS  RESEARCH  CENTER  F/G  12/1 

robustnlss  and  efficiency  problems  of  some  randomization  PROCED— ETC(U) 

OCT  77  C wU  DAAG29-75-C-0024 

MRC-TSR-1797  NL 


AO  A049424 


NRC  Technical  Sunary  Iteport  i 1797 


ROBUSTNESS  AND  EFEXCIEMOr  PROBUNS  OP 
SOME  RANDOMIZATION  PROCEDURES  IN 
EXPERIMENTAL  IXSIGNS 


Chien-Pu  Wu 


Mathematics  Research  Center 
University  of  Wisconsin— Madison 

610  Walnut  Street 
Madison,  Wisconsin  53706 

October  1977 

(Received  August  24,  1977) 


Appravttf  far  public  rail 
Oistribatiaa  anliaiitad 


Sponsored  by 

U.S.  Army  Research  Office 
P.  O.  Box  12211 
Research  Triangle  Park 
North  Carolina  27709 


^ D C 

A’  FEa  2 l?78 

' i 


— ij  16^  i 


i 

.V. 


UNIVERSITY  OF  WISCONSIN  - MADISON 
MATHEMATICS  RESEARCH  CENTER 

ROBUSTNESS  AND  EFFICIENCY  PROBLEMS 
OF  SOME  RANDOMIZATION  PROCEDURES 
IN  EXPERIMENTAL  DESIGNS 

Chien-Fu  Wu^ 

Technical  Sununary  Report  • 1797 
October  1977 

ABSTRACT 


D D C 


A concept  of  model -robust ness  is  defined  in  terms  of  the  performance  of 
the  design  in  the  presence  of  model  violations.  Ibe  robustness  problem  is  dis- 
cussed for  several  randomization  procedures  conmonly  used  in  experisental  design 
situations.  Among  them,  the  completely  randomized  design,  the  randosdzed  block 
design  and  the  randomized  Latin  square  design  are  sho%m  to  be  model-robust  in 
their  own  settings.  To  compare  different  randomization  procedures,  a concept  of 
efficiency  is  also  defined.  This  concept,  when  applied  to  different  designs, 
gives  results  which  are  consistent  with  the  intuitive  grounds  on  which  the  designs 
are  suggested. 
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In  designing  an  experiment,  the  treatments  are  usually  assigned  to  the 
experimental  units  randomly.  In  Planning  of  Experiments  (Cox,  1958),  two 
reasons  for  practicing  randomization  are  given:  to  prevent  the  systematic 
biases  from  unknown  sources  of  variation  and  to  enable  the  error  to  be  esti- 
mated whatever  the  form  of  the  uncontrolled  variation.  So  far  all  these  reasons 
are  stated  in  quite  vague  forms.  A model  robust  approach  is  developed  rigourous- 
ly  in  this  paper  to  justify  the  practices  of  randomization.  The  idea  is  to 
consider  a collection  of  all  possible  violations  of  the  assumed  model  and  to 
choose  a randomized  design  which  will  perform  well  over  such  a collection  of 
model  violations.  Classical  randomized  designs  like  the  completely  randomized 
design,  the  randomized  block  design  and  the  randomized  Latin  square  design  are 
justified  in  this  framework.  A concept  of  efficiency  is  also  defined.  Different 
randomization  procedures  are  compared  in  terms  of  their  efficiencies.  Our 
approach  thus  provides  a quantitative  basis  on  which  various  randomization  pro- 
cedures can  be  assessed. 
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The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive  summary 
lies  with  MRC,  and  not  with  the  author  of  this  report. 


ROBUSTNESS  AND  EFFICIENCY  PROBLEMS  OF 
SOME  RANDOMIZATION  PROCEDURES  IN 
EXPERIMENTAL  DESIGNS 

Chien-Fu  Wu^ 


1.  Introduction 

The  old  problem  of  randomization  in  experimental  desi<7n  is  treated  from 
a new  point  of  view.  For  comparing  T different  treatments  on  N experimental 
units,  the  experimenter,  with  em  exact  model  assumption  in  his  mind,  will  assign 
the  treatments  to  the  units  in  a systematic  way  which  is  optimal  in  the  usual 
sense.  This  is  certainly  not  a good  ground  for  justifying  the  use  of  randomiza- 
tion. In  fact,  the  experimenter's  information  about  the  model  is  never  perfect. 
When  a model  is  proposed,  there  is  always  the  possibility  that  the  "true"  model 
deviates  from  the  assumed  model.  Let  G be  the  collection  of  all  the  possible 
"true"  models.  Concepts  of  model-robustness  with  respect  to  G are  defined  in 
terms  of  minimizing  the  maximum  possible  mean  square  errors  (m.s.e.)  of  the 
corresponding  best  linear  unbiased  estimator  (B.L.U.E.)  over  G.  In  Section  2, 
some  randomization  procedures  commonly  used  in  experimental  design  are  shown  to 
be  model-robust  with  respect  to  any  G which  possesses  invariance  property. 

A similar  result  for  simple  random  seunpling  was  obtained  by  Blackwell  and 
Girshick  (1954) . For  non- invariant  G,  a sufficient  condition  on  G for 
minimaxity  is  also  given.  This  optimality  property  actually  holds  for  other 
types  of  problems,  including  violations  of  the  homoscedasticity  assunption  of 
the  error  terms  and  the  estimation  of  variance  under  either  typ>e  of  violation. 
Although  many  goc-*  oroperties  of  randomization  are  well-known  (see,  for  example, 
Cox,  1958) , nor  .em  are  stated  as  an  optimality  property.  The  minimax 

^The  work  was  done  while  the  author  was  in  the  Department  of  Statistics, 
University  of  Califomia-Berkeley . 
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• s proved  in  this  paper  are  thus  new  justifications  for  the  practices  of 
randomization  in  experimental  design.  As  a by-product,  several  randomization 
procedures  for  the  Latin  square  design  are  reassessed  in  this  framework.  The 
standard  practice  of  choosing  a Latin  square  arbitrarily  and  then  randomly 
permuting  its  rows,  columns  and  treatments  is  shown  to  possess  soc?  desirable 
properties. 

In  Section  3,  the  efficiency  comparisons  of  several  procedures  (systema- 
tic, partially  randomized,  completely  randomized)  are  made  in  terms  of  the 
maximum  possible  bias  square  over  a particular  choice  of  G.  The  calculations 
of  the  m^uciIna  are  reduced  to  some  sinqple  combinatorics  by  considering  the  set 
of  extreme  points  only  (due  to  convexity) . The  efficiency  of  the  systematic 
arrangements  relative  to  the  completely  randomized  arr2mgements  is  inversely 
proportional  to  the  number  of  replications  of  each  treatment.  A randomized 
block  design  is  shown  to  be  very  efficient  when  the  block  size  is  moderate  or 
leurge.  Other  partially  randomized  designs  like  the  randomized  cluster  design 
£md  the  cross-over  design  are  not  as  efficient,  although  a ccxnbined  use  of 
randomized  block  and  cluster  designs  can  be  very  efficient.  Conditions  for 
these  designs  to  be  superior  to  the  completely  randomized  design  (CRD)  are  also 
given  in  terms  of  the  special  patterns  of  the  model  violations.  These  patterns 
are  quite  consistent  with  the  intuitive  grounds  on  which  these  designs  are 
suggested.  For  example,  the  cross-over  design  with  two  treatments  is  better  than 
the  CRD  if  more  then  85%  of  the  blocks  have  "positive"  cross-over  effect  (to  be 
defined  in  Section  3)  and  less  than  15%  of  the  blocks  have  "negative"  cross-over 
effect.  The  efficiency  concept  introduced  here  thus  makes  it  possible  to  compare 
different  randomization  procedures  quantitatively. 

2.  Model-robustness  of  some  randomized  designs 

Let  T different  treatments  be  con?>ared  on  N experimental  units  with 


I 


'1 
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units  assigned  to  the  t-th  treatment,  I ■ N.  Assume  that  the  follow- 
ing model  is  true: 

(2.1)  V “ * “t  ♦ 'ut  • 

where  is  the  response  of  treatnent  t assigned  to  unit  u,  is  the 

T 

t-th  treatment  effect,  Y n^o^  ■ 0,  e ^ is  the  random  error  with  rero  mean 

til  ' ' 

and  equal  and  uhcorrelated  variances.  Under  this  model,  any  arbitrary  assign- 
ment of  n^  units  to  the  t-th  treatment  gives  the  same  mean  square  error  of  the 
best  linear  unbiased  estimator  (t  ■ !,••••,  T) . Therefore,  randomization 
does  not  seem  to  be  necessary  in  such  a situation.  From  a mathematical  point  of 
view,  such  an  exact  model  assun^tion,  in  fact,  any  exact  model  assumption,  can 


not  justify  the  use  of  randomization  procedures.  Instead  we  will  consider 
different  possible  violations  of  the  assumed  model  and  find  designs  which  are 


minimax  with  respect  to  these  model  violations.  This  is  the  rationale  of  the 


model-robust  approach  adopted  in  this  paper. 

To  include  some  other  unknown  effects,  the  following  modified  mcxlel  is 


considered: 


^ut  = " * “t  * ^ "ut 


where  g e G = {g : ^ g(u,t)  = 0 and  other  assumptions  to  be  defined)  , 

u=l 

T N 

assumptions  on  {a  } , and  {e  } , are  the  same  as  in  (2.1).  The  function 

t t*l  ut  u*l 

g(u,t)  can  be  interpreted  as  the  unknown  joint  effect  of  the  unit  and  the  treat- 


ment. The  assunption  ^ g(u,t)  » 0 is  for  obvious  technical  reasons.  Other 

u=l 

assun^tions,  which  are  not  yet  defined,  on  G will  reflect  the  model-builder's 
knowledge  cd>out  g.  An  important  example  of  G is  {g  : [g]  £ c ^md 


-3- 


I 


I g(u,t)  • 0).  This  reflects  the  fact  that  very  little  is  known  about  the  type 
u«l 

of  model  violation  except  that  it  is  possible  to  happen  anywhere  in  a neighbor- 
hood of  zero.  Model  (2.2)  without  the  specification  of  g in  G was  considered 
by  Ken^thorne  (1955)  from  a different  standpoint. 


* {u  : u is  assigned  to  the  t-th  treatment) 

T 

and  call  I * t^t^t»l  ® pattern.  In  design  terminology  I corresponds  to  a 

non- randomized  design.  Mathematically  I is  just  a partition  of  {l,*"'*  n) 

into  T subsets  with  cardinalities  ^ ^ collection  of  such 

I's.  A reuidomized  design  n is  defined  as  a probability  measure  over  I,  i.e., 

{n(l)},  T with  n(l)  lO  and  ^ n(I)  - 1. 

UI 

Since  the  statistician  knows  very  little  about  the  g's  in  (2.2),  he 
might  as  well  assume  g » 0 in  estimating  {o^}.  This  is  particularly  suitable 
when  no  more  known  effects,  for  example,  covariates,  blocking  etc.  cem  be  in- 
cluded in  the  model  and  when  c is  small.  The  sum  of  m.s.e.'s  of  the  B.L.U.E. 
a^'s,  under  model  (2.2) , becomes 


I E{(a^  “ ° ^ ^ ^ ^ g(u,t)}^  ^ ‘ ^ " n’  • 


t-1  t U£l. 


t-1  t 


T ^2 

For  fixed  {n  } ,,  the  only  relevemt  quantity  is  a(I,g)  * 2.  g ^ » 

t t-1 

•*1  T 

where  g ^ = n~  Y g(u,t)  . If  {n^}^  , are  not  fixed,  they  should  be 

. t t t t=l 

chosen  as  equal  as  possible  and  then  bias  reduction  only  needs  to  be  considered. 

For  a randomized  design  n,  the  expected  bias  square  is  then 

r(Ti,g)  =*  ^ Ti(I)a(I,g) 

leJ 


r 


This  becomes  a game  with  "risk"  r(n,g)  between  the  experimenter  and  nature; 
the  experimenter  can  choose  any  probability  measure  n over  I and  nature  can 
choose  any  g,  corresponding  to  an  unknown  true  model,  from  G. 

A design  n*  is  called  rainimax  (or  model -robust)  with  respect  to  model 
(2.2)  if  it  achieves 


i • 


min  max  r(n<9) 
n gcG 

For  g e G and  n a permutation  of  {!,••••,  n),  let  ng  be  defined 
as  TTg(u,t)  » g(iT  ^u,t)  . 

Theorem  1.  Suppose  G satisfies  the  invariance  property; 


(2.3) 


g c G • ng  £ G 


for  any  permutation  n.  Then  the  uniform  design  the  completely  randomized 

design,  is  minimax  with  respect  to  model  (2.2). 

T 

Proof.  For  any  permutation  n,  define  nl^  * {n(u)  ; u £ t“l 

and  n (I)  = n(nl).  Given  any  n*  1 n “ n*f  where  P is  the  collection 
of  all  permutations. 


H£P 


max  'l  ri*(I)a(I,g)  * ^ max  ^ ^ n (I)a(I,g)} 

gfG  l€g  gcG  n£P  IcI  * 


1 N!  ^ ^ n(iH)a(I,g) } 

n£P  g£G  l£j 

^ max{  \ n(ffl)a(nl,ng) } 


n£P  gfG  lei 


“ N!  ^ ^ n(J)a(J,ng)  } 


n£P  g£G  Jel 


” N!  ^ ^ n(J)a(J,g)} 


(from  (2.3)) 


TTfiP  g€G  3el 


= max  Y n(J)a(J,g)  , 
geG  J£j 
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where  a(irl,irg)  » a(I,g)  follows  from  the  definition  of  »I  and  »g. 

Q • C • D • 

In  order  to  compare  the  robustness  of  various  designs  in  a siore  definite 

way,  the  following  assumption  on  g(u,t)  is  needed.  If  g(u,t)  • g(u)  h(t), 

i.e.  no  "interaction"  between  unit  and  treatment,  by  absorbing  h(t)  into  o^, 

the  only  relevant  quantity  becomes  ^ n(I)a(I,g)  with  a(I,g) 

Id 

T _i  2 

« {n  ^ g(u)}  . Define  the  random  variables  for  t ■ !,•••,  T 

t-1  ^ ucl^ 


x^(u) 


if  u c I^  , 


if  VI  i I^. 


Therefore  I g(u)  * I g(u)  X (t) . If  we  further  assume  that  n^  ■ n 


for  all 


U€l. 


U-1 


t,  we  have 


r -2 

I n(I)a(I»g)  = n E| 
l£l 


T r N 12 

I g(u)  X (u) 
t-lU*l 


where  expectation  is  t2Uten  with  respect  to  the  probability  over  I.  This  is 
equal  to 

/• 

T N 


(2.4) 


i I g^(u)X^(u)  + i I g(u)g(v)X^(u)X^(v) 
]t=l  u=l  t=l  u*v 


- n"2  p 

= n E 


N I T 

I g^u)  + I g(u)g(v)/  I X^(u)X^(v)' 


= n 


u=l 
N 

I 

U=1 


uxv 


t=l 


^ I g^(u)  + I g(u)g(v)  ^ , 

UXV 


where  it  = P (u  auid  v being  assigned  to  the  same  treatment) 
uv 
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Under  the  above  additivity  and  equal  replication  assunptions,  the  degree 
of  robustness  of  a design  depends  on  its  second  order  inclusion  probabilities 


^^uv^u*v'  often  have  an  interpretation  in  sampling  theory.  This  simple 


device  makes  possible  the  efficiency  comparisons  of  Section  3.  Another  advan- 
tage of  the  additivity  assumption  is  in  the  Latin  square  design,  where  the  less 
conclusive  result  of  Theorem  3 is  strengthened  in  Corollary  1 under  this  assump- 
tion. 

The  following  relations  and  (2.4)  are  useful  for  later  calculations. 

N 


(2.5) 


g (u)  ■ - ^ g(u)g(v)  , 

U“1  u*v 


since 


^ g(u)  * 0 
u-1 


(2.6) 


I ^ 


V 

V*U 


uv 


(n-1) 


(2.7) 


* n-1  * 

IT  = — r,  for  equal  n , where  N * nT 
uv  N-1  uv 


For  the  complete  block  designs,  we  assume,  for  the  sake  of  simplicity, 
that  T treatments  are  compared  on  b blocks  each  of  size  T.  If  model  (2.8) 
is  assumed,  it  is  clear  that  the  optimal  design  is  to  assign  T treatments  to 
each  block  irrespective  of  the  arrangements  of  the  treatments  in  the  block. 

Let 

(2.8)  Vut  = ^ “t  ®i  ^ "ut  ' 

T b 


where  7 a = T 6.  = 0,  a is  the  t-th  treatment  effect  (t*!,**,  T)  , 
^ t ^ 1 t 

t=l  ^ i=l 


6.  is  the  i-th  block  effect  (i=l,"*,  b)  , 
1 


(If! 


I, ; 

I 

i \ 


ij 


\ 


ij 

1 u 
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u » (i.j)  (j  ■ 1,‘*‘.T)  are  the  T experimental  units  in  the  i-th  block,  and 

{e  } have  mean  0,  equal  variance  and  are  uncorrelated  for  different  u's. 
ut  u 

A more  realistic  modelling  is  to  consider  the  following: 

(2.9)  ~ ^ \ * h * * "ut  ' 

where 

g e G - {g  : J]  g(u,t)  ■ 0 and  other  assumptions  to  be  defined)  , 
u 

assumptions  on  {a^},  ^^ut^  same  as  in  (2.8). 

A 

With  the  S6une  rationale  as  in  model  (2.2)  the  estimate  is  chosen  to 

^ 1 T* 

be  the  B.L.U.E.  under  model  (2.8),  i.e.  a..  “ ^ i Y “ V * Since  the 

Z D _ MZ  • • 

U.I^ 

T 

corresponding  ^ Var(a  ) is  independent  of  the  arrangements  of  the  T 
t»l  ^ 

treatments  within  each  block,  the  choice  of  design  is  determined  by  the  bias 
square  terms.  Formally  we  define 

= {(i,j)  : (i,j)  is  assigned  to  the  t-th  treatment) 

, I =TTi‘'’  . 

t=l  i=l 

Each  I corresponds  to  a systematic  complete  block  design.  L«t  J be  the 
collection  of  all  such  I's.  Definitions  of  randomized  design  *1,  a(I,g),  r(n,g) 
and  minimaxity  with  respect  to  model  (2.9)  are  analogous  to  those  for  model  (2.2). 
Let  be  a permutation  of  (l,****,  t)  for  the  i-th  block  and 

b 

n = 1 r IT..  Further  irl  and  irg  are  defined  in  an  obvious  way.  It  is  easy 

to  see  that  a (irl,  iig)  = a(I,g)  and  thus  the  proof  of  Theorem  2 is  essentially 
the  same  as  that  of  Theorem  1. 

Theorem  2.  Suppose  G satisfies  the  invariance  property  (2.3)  for  all 
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b 

Ti  “ ] I"  It.,  the  uniform  design  n*/  the  randomized  block  design  in  the  usual 
i-1  ^ 

sense,  is  minimax  with  respect  to  model  (2.9). 

Since  there  does  not  exist  a simple  transformation  which  maps  a transfor- 
mation set  of  Latin  squares  (L.S.)  into  another  set,  the  application  of  the 
invarizuice  technique  used  before  is  more  restricted.  The  following  result  is 
thus  not  as  conclusive  as  the  previous  two. 

The  following  model  for  L.S.  designs  is  proposed  in  the  Scune  spirit  as 
models  (2.2)  and  (2.9): 

(2.10)  * r.  * ,(u,t)  . 

T T T 

where  1 B.  = ^ r.  = 0,  u=(i,j)  , 

t=l  ^ i=l  ^ j-1  ^ 

a , 6.,  r.  are  the  t-th  treatment  effect,  the  i-th  row  effect  and  the  j-th 
t i 3 

column  effect  (i,j,  t = 1,**,  T),  g € G * {g  : ^ g(u,t)  = 0 and  other  assump- 

u 

tions  to  be  defined);  we  also  make  the  usual  assumptions  on 

Let  {/.}.  , be  the  totality  of  transformation  sets  of  Latin  squares. 

1 1=1 

Formally  we  define,  for  i = I,**,  k, 

I.  = {its.  ; IT  € P)  , 

1 1 

where  s^  is  a generating  L.S.  for  and  P is  the  group  of  permutations 

of  rows,  columns  and  treatments.  A natural  correspondence  between  and 

I.  is  the  map  : tt  s,  it  S . for  all  tt  e p.  Note  that  here  we  do  not  identify 
3 

the  identical  L.S.'s  cimong  the  (T!)^  squares,  i.e.  every  square  in  is  con- 

sidered as  "different".  As  we  shall  see  later,  this  will  save  a lot  of  effort 
of  randomization,  compared  to  the  practice  of  randomizing  over  the  set  of  reduced 


squares . 


A remdomized  L.S.  design  is  defined  as  a probability  measure  n over 
k 

U I..  The  measure  n*  is  called  minimax  with  respect  to  model  (2.10)  if  it 
i=l  ^ 

achieves 

min  max  r(n>g)  , 
n geG 

where  r(n.g)  * ^ n(I)a(I,g)  , 

k 

IcUJ. 

i»l 

T 

a(l,g)  = i (^  Z g(u,t))^  , 

t*l  uel^ 

= {u  : u is  assigned  to  the  t-th  treatment} 

Write  nd)  = with  c^  equal  to  the  probability  of  choosing 

the  transformation  set  containing  I and  ri(l|j^)  equal  to  the  conditional 

probability  of  choosing  I within  by  applying  the  permutations  of  rows, 

columns  and  treatments,  the  choices  of  ri(l|J^)  can  be  reduced.  To  sin^Jlify 
the  notation,  we  write  ndji)  for  nCll-T^). 

For  ir  c p and  geG,  define  Trg(u,t)  = g(TT  ^(u,t))  . 

Theorem  3.  Suppose  G satisfies  the  invariance  property  (2.3)  for  all  tt  e P, 
in  obtaining  the  minimax  designs  for  model  (2.10),  it  suffices  to  consider 
those  n*'s  with  n^dl-T^)  the  uniform  measure  on  for  each  i. 

Proof:  For  each  ri»  we  have 

n*(ili)  * (Tt)"^  I n(Tili) 
xeP 

for  all  I c and  i=l,**  , k 
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i 

I 


of  the  uncontrolled  variation  - is  also  closely  related  to  the  result  stated  at 
the  end  of  the  section.  Unfortunately  none  of  these  reasons  are  stated  as  opti- 
mality properties.  The  minimax  results  proved  in  this  section  are  thus  new 
justifications  for  the  practices  or  randomization. 

For  the  L.S.  design  problem,  if  we  further  assume  that  g(u,t)  » g(u)  + h(t), 
a similar  calculation  to  (2.4)  gives 

I n(l)a(I,g)  =\f  I g^(i»j)  + I g(i,  j)g(i' , j')Tr 

UI  T 

j*j’ 

where  u = (i,j),  u'  = (i’,j')  are  two  different  units  in  the  square  and 

TT  . = P (u  and  u'  receive  the  same  treatment) . Since  this  only  depends  on  the 
uu' 

second  order  inclusion  probability  tr  all  the  randomization  procedures  n*'s 

uu' 

stated  in  Theorem  3,  having  equal  thus  minimax. 

Corollary  1.  Under  the  additional  assumption  g(u,t)  = g(u)  + h(t),  all  the 
n*'s  stated  in  Theorem  3 are  minimax. 

In  particular,  the  complete  randomization  within  a transformation  set  is 
minimax.  This  will  greatly  simplify  the  randomization  procedure  for  Latin  squares 
in  the  Fisher-Yates  Tables  (1953).  Instead  of  randomizina  first  over  the  class  of 
transformation  sets  and  then  within  a particular  set  (the  Fisher-Yates  "recipe") , 
it  is  sufficient  to  consider  any  procedure  n with  equal  simplest 

one  is  to  choose  any  Latin  square  and  then  randomly  permute  its  rows  (or  columns) . 
This  is  especially  convenient  for  higher  order  Latin  squares  where  the  class  of 
transformation  sets  is  not  available.  It  is  interesting  to  note  that  both  the 
equal  procedure  and  the  Fisher-Yates  procedure  were  mentioned  in  Fisher's 

definition  of  Latin  square  in  his  1926  paper.  However,  no  justification  for  the 
equal  procedure  was  given  there: 


-12- 


Consequently,  the  term  Latin  Square  should  only  be  applied 
to  a process  of  randomization  by  which  one  is  selected  at  random 
out  of  the  total  number  of  Latin  Squares  possible;  or,  at  least, 
to  specify  the  agricultural  requirement  more  strictly,  out  of  a 
number  of  Latin  Squares  in  the  aggregate,  of  which  every  pair  of 
plots,  not  in  the  same  row  or  column,  belongs  equally  frequently 
to  the  same  treatment  (Fisher,  1926) . 


The  same  invariance  technique  can  be  used  to  show  that  some  other  random- 
ized designs  are  minimax  with  respect  to  an  invariant  G.  For  example,  in  the 
BIBD  case,  the  standard  method  of  randomizing  the  blocks,  the  units  within  each 
block  and  the  treatment  numbers  is  minimax  with  respect  to  such  a G;  in  the 
first  order  multi-factor  design,  the  device  of  "angular  randomization"  (Box, 
1952)  makes  the  design  minimax  with  respect  to  the  set  of  second  order  models. 

If  G does  not  possess  the  invariance  structure,  to  what  extent  will  the 
alaove  miniitieix  results  still  hold? 

For  the  completely  randomized  design  (CRD) , let  us  assume  that 
n^  = n (t=l,*»,  T)  and  g(u,t)  = g(u)  + h(t) . From  (2.4),  the  only  relevant 
N 2 

quantity  is  J g (u)  + 'I  g(u)g(v)iT  for  g c G.  Its  maximum  is  attained 
u=l 

at  the  set  of  extreme  points  of  G-  Decompose  = U Ar  with 

r 

2 

Ar  = {g  ; g e G , ||gl|  = r}  n 6. 

Theorem  4.  For  any  r with  non-empty  Ar,  there  exists  a probability  measure 

p on  Ar  such  that 
r 

/ g(u)g(v)p  (dg)  = c < 0 for  all  u * v 
Ar  ^ 

Then  any  randomization  procedure  n*  with  equal  minimax  with  respect 

to  model  (2.2).  In  particular,  the  CRD  is  minimax  with  respect  to  model  (2.2). 


I 


k 

1 


i 


L3- 


Proof.  It  is  enough  to  show  that  n*  minimizes 


N 


i I g (u)  + I g(u)g(v)n^^} 


m^uc 

gcAr  u=l  u*v 

for  each  non-empty  Ar.  On  Ar  , 

N 


I g'^Cu)  + I g(u)g(v)iT^^  = r + ^ 5;  g(u)g(v)  - ^r  , 

U=1  ua^V  U*V 


N-n 


from  (2.5) . 


If  is  considered  as  a "Bayesian  prior"  on  Ar,  the  corresponding 


"Bayesian  risk" 


J {r  + I Tr^^g(u)g(v)  }p^(dg)  = r + c^^  I it 


Ar  u*v 


u*v 


uv 


is  minimized  by  taking  all  the  ’’yy'®  equal.  This  shows  that  the 

"decision  procedure"  n*  with  equal  has  constant  risk  on  Ar  and  is 

"Bayes"  with  respect  to  a "prior"  p^;  thus  it  is  minimax  with  respect  to  Ar. 

Q.E.D. 

For  G satisfying  the  invariance  property  (2.3),  one  choice  of  p^  in 
Theorem  4 is  euiy  probability  invariant  under  the  permutations  of  N}. 

Theorem  4 is  thus  a generalization  of  the  previous  results  under  some  stronger 
assunqptions.  Its  extensions  to  other  design  situations  are  straightforward 
but  tedious. 

The  technique  developed  so  far  can  also  be  used  to  give  minimax  results 

for  other  types  of  problems.  Two  of  these  that  will  be  discussed  are:  (i)  the 

estimation  of  when  the  homoscedasticity  assumption  of  the  error  terms 

2 

is  violated  and  (ii)  the  estimation  of  o under  model  (2.2).  For  the  sake 
of  simplicity,  only  the  complete  randomization  case  is  considered. 


-14- 


Consider  the  following  model 


(2.11) 


'ut 


'ut 


The  assumptions  are  the  same  as  in  model  (2.1)  except  that  Cov({e^^}**  ) » $ 

^u*l 

with  f coming  from  a set  E.  For  any  pattern  I » » the  B.L.U.E. 

t-1 

of  {a. is 
^ t=l 

{a  * {y^.  - y..>^  * (P  - J)y  , 

t=l  t-=l 


where 


P = la^.l 


txN 


t-> 


if  j e , 
if  j -i  Ij.  » 


euid  J is  the  T x N matrix  with  all  the  entries  equal  to  N 
Its  variance-covauriance  matrix  is 


Cov 


(P  - J)t(P  - J)"^  = a(i4) 


For  a randomized  procedure  n#  the  corresponding  variance-covariance  matrix  is 

I n(i)A(i4)  = R(n4)  • 

leJ 

The  design  n*  is  called  minimax  with  respect  to  model  (2.11)  if  it 
achieves 

min  max  tr{R(n>t)}  > 
n ^eE 

where  trR  is  the  trace  of  the  matrix  R . 

For  any  permutation  it,  define  = (t)  for  all  i,j  . II 

IT  i,1T  j 


easy  to  see  that  A(itl,iit)  = A(I,^)  and  the  proof  of  the  following  theorem  is 
essentially  the  same  as  that  of  Theorem  1. 


Theorem  5.  Suppose  E satisfies  the  invariance  property  (2.3),  i.e. 

it  € E ^ Tit  e E for  all  it,  the  uniform  design  n*  is  minimax  with  respect  to 

model  (2.11)  . 

Excm^iles  of  E satisfying  (2.3)  include 

Eq  = (t  = ^ for  all  i,j} 


and 


• lOijl  , . ■ »ii  • '’'•'’ij  • 0 < < .,  -I  i P 1 1) 


i»D 


2 


and 


Under  model  (2.2),  the  usual  estimator  of  a is 

5^  = (N-T)"^  I I - y.^)^ 

t=l  uel^ 


1(5^)  - = (N-T)“^  I I (g{u,t)  - g )^  , 

t=l  U€l^ 


where  g 


n”^  I g(u,t).  Let  a(I,g)  =11  (g(u,t)  - g.^)  . A design 

uel^  t=l  u£l 

t ^ 


2 

ri*  is  called  minimax  with  respect  to  model  (2.2)  for  estimating  o if  it 
achieves 

min  max  ^ n(I)a(I,g) 
n gcG  leJ 

It  is  clear  that  the  relation  a(TrI,7rg)  = a(I,g)  holds  and  the  minimax  result 
2 

for  estimating  o follows  as  usual . 

3.  Efficiency  comparisons  of  some  randomization  procedures. 

In  this  section,  we  attempt  to  evaluate  more  precisely  the  gains  and  losses 
in  using  various  ran  lomization  procedures.  The  efficiency  comparisons  are  made 
under  the  assumptions:  g(u,t)  = g(u)  + h(t) , n^  = n (t=l,**,T)  and 


-16- 


u 


1 


I 


G * {g  : i g(u,t)  = 0,  lg(u,t)|  ^ c) . Both  model  (2.2)  and  model  (2.10)  are 
u=l 

considered.  All  the  calculations  are  based  on  (2.4)  and  Lemma  1.  For  any 

randomization  procedure  ti»  its  efficiency  is  then  measured  by  the  maximum  of 
N 

S(n,g)  = I g (u)  + I g(u)g(v)ii^^  over  G. 
u=l  uxv 

The  following  lemma  will  be  referred  to  very  often  in  the  efficiency  cal- 
culations . 

N 

Lemma  1.  The  set  E of  extreme  points  of  {g  ; ^ g(u)  * 0 and  lg(u)|  c) 

u=l 

is 

(3.1)  (i)  For  N even,  {c(l,**,l,  -1, ••,-!)  and  its  permutations) 


N 

2 


N 

2 


(3.2) (ii)  For  N odd,  {c(0,  1,**,1,  -1, ••,-!)  and  its  permutations)  . 


N-1 

2 


N-1 

2 


In  particular,  the  maximum  of  a convex  function  of  {g(u))^^j^  over  G is 
attained  at  one  of  the  points  in  E. 

Proof.  It  is  clear  that  the  set  of  points  in  (3.1)  and  (3.2)  are  in  E. 

(i)  N even.  Suppose  * point  of  the  form  (3.1),  we  can 

find  i < j with  (a^|,|a^|  < 1 . Also 


i (a^,..,a.+6,--,a.-6,.-,a^) 

for  small  6 shows  that  extreme  point, 

(ii)  N odd.  Among  the  points  ^*i'**'*n^  with  |a^| 


0 or  1,  only  the  set 


of  points  in  (3.2)  are  in  E.  Otherwise,  we  can  find  i < j with  la^l*|ajl  * 1- 
The  rest  of  the  proof  follows  from  (i) . 

Q.E.D. 

From  the  result  of  Lemma  1,  the  relative  efficiency  of  one  procedure  to 
another  is  independent  of  c,  the  radius  of  the  neighborhood  G.  Without  loss 
of  generality  we  can  therefore  assume  that  c is  equal  to  1 in  the  following 
efficiency  comparisons. 

Example  1 . Completely  Randomized  Design  (CRD) . 

From  (2.5)  and  (2.7) , 

n , N 

s(n,g)  = (1  - ~)  I g (u)  . 

u=l 

According  to  Lemma  1, 


max  s(ri,g)  = < 

[Nin  N 
^ N-1 

for 

N 

even  , 

- 

geG  I 

1 N-n 

for 

N 

odd 

• 

Note  that  the  maximizing  g can  be  any  point  from  the  set  E. 

This  calculation  amounts  to  saying  that  all  procedures  with  equal 
are  minimax  with  respect  to  model  (2.2) . In  particular,  the  CRD  is  minimax. 
The  following  question  arises  naturally:  does  there  exist  another  minimax  de- 
sign n whose  support  is  smaller  than  the  support  of  the  CRD,  the  whole  17 
The  answer  is  yes!  By  identifying  the  CRD  with  the  simple  random  sampling, 
the  radomized  block  design  (example  3)  with  the  stratified  random  sampling  and 
the  randomized  cluster  design  (example  4)  with  the  cluster  sampling,  a result 
in  sampling  theory  can  be  used.  In  the  design  terminology,  this  result  says 
that  there  exists  a convex  combination  of  randomized  block  and  randomized 
cluster  designs  which  gives  equal  n^^'s.  The  support  of  this  combined  design 
is  much  smaller  than  I.  For  technical  details,  see  Wynn  (1977). 
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Example  2.  Systematic  Design. 

The  design  measure  for  the  systematic  design  is  a point  mass 
nj  with  nj(l)  = 1,  I is  a pattern. 

s(n',g)  = I f I,  g(u)'\  ^ * I 

t*lVueI^  J t«l 

T 

where  g(u) . The  constraints  on  {A  } are  \ A * 0 and 

ue t«l 

Ia^I  in  . 

(i)  T even.  According  to  Lemma  1,  by  taking  A^  = n for  t even  and 

A^  * -n  for  t odd,  we  have 

2 

max  s(r)-,g)  = T n = Nn 
geG  ^ 

(ii)  T odd.  According  to  Lemma  1,  by  taking  A^  = n for  t even, 

A^  = -n  for  t odd  (<  T-1)  and  A =0,  we  have 
t — T 

2 

max  s(n',g)  = {T-l)n 
gcG  ^ 

The  relative  efficiency  with  respect  to  the  minimax  value  is 

N-n  N-n  ,1  , „ 

N/Nn  = /n  < - for  T even, 

N-  i N- 1 n 

N/ (T-1)  n^  = T/(nT-l)  — — for  T odd  and  n even, 

N”1  n 

2 1 

N-n/(T-l)n  = — for  T , n odd. 
n 

Therefore  the  loss  of  efficiency  in  terms  of  the  bias  squares  for  the  systema- 
tic design  is  proportional  to  the  number  of  replications  of  each  treatment. 

For  moderate  or  large  n,  unless  a specific  pattern  of  the  model  violations 


is  known,  it  is  not  advisable  to  use  a systematic  design. 


1 


Example  3.  Randomized  Block  Design  (RBD) . 
Divide  the  N units  into  I blocks 


and  assign  T treat- 


ments each  with  j replications  (n  being  divisible  by  t)  completely  randomly 


to  each  of  the  I blocks . 


For  u X V e I 


(i)  n(n-f)  n-i 

' ’’uv  “ ^ N(N-f)  “ N-S. 


For  u € , V e , i * j . ” 


1 

S — 

uv  T 


From  (2.5) , 


. N 

y g(u)g(v)iT  = I g(u)g(v)  + -(-  y g(u)-  I g(u)g(v)) 

^ uv  N-t  ^ HI 

U*v  uJ^vel'^ 


u^vel 
N 


Therefore  s(n,g)  = I g^{u)  - I g(u)g(v) 


u=l 


(i) 


uxvel 

From  Lemma  1,  it  suffices  to  consider  only  the  set  E.  Define 


y g(u)g(v)  = y { (m^-n^)  - (m^+n^) } , 

U^€l 

, , /t-1  (N-n)  V I \ (N-n)  £ r ^ 

‘(n.g)  ■ ^ T N(N-)l)J  ”*1  i N(N-«,)  i i 


(3.3) 


N-n  r , . . f(N-n)  r 

■ .i,  ‘V"i’  • TOPir  '"i  "i’  • 

1=1  1=1 


i=l 

2 


Itiis  is  maximized  by  taking  jm^  ” "^i^  small  as  possible  and  m^  + n^ 

as  large  as  possible. 


I? 


! 

m.  = number 

of  u 

from 

with 

g(u) 

equal  to  1 , 

• 1 

1 

!| 

'? 

ii  n.  = number 

of  u 

from 

with 

g(u) 

equal  to  -1  , 

-20' 


(i)  j even.  By  t2Ucing  ”'i  “ ^ ^ ' 


max  s{n,g)  » N 


(ii)  Y odd.  Obviously  should  be  taken  to  be  ±1  or  0>  for 

- n^  = ±1,  the  biggest  possible  + n^  is  j;  for  - n^  ■ 0,  the 


biggest 

1 [ 

possible 

m.  + n . 

1 1 

is 

N 

£ 

1 . 

! Let 

1 

P 

= number 

of 

i's 

with 

m.  - 
1 

n. 

1 

equal 

to 

1 

= number 

of 

i’s 

with 

m.  - 
1 

n . 

1 

equal 

to 

-1  , 

1 

£ - 2p 

= number 

of 

i's 

with 

m.  - 
1 

n. 

1 

equal 

to 

0 . 

H 2 ^ 

Therefore,  7 (m.-n.)^  = 2p  and  the  biggest  possible  T (m.+n.)  is 
. 11  . , 1 1 
1=1  1=1 

I 2p  + - 1)  (X  - 2p)  = N - £ + 2p  - 

N*n 

For  such  a g,  s(r)/g)  = N - n + 2p  is  maximized  by  talcing  2p  = £ for  I 

N 

even  and  £ - 1 for  I odd. 


(I)  I even,  max  s{T\,g)  = (N-n)  (N+)l)/N 
geG 


{ID  £ odd.  max  s(Ti,g)  = (N-n)  (N+£-l) /N  . 
GeG 


The  relative  efficiency  to  the  CRD  is 


N-1  N-£  ^ N 

; r — = — ~ for  — even 

N (N-n)  N-1  £ 


(N-n) 

- (N-n) 


TN^£)-ai-D  I 


N-n 

N+£-l 


(N-n) 
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t- 


When  — is  close  to  0,  the  relative  efficiency  is  close  to  1-  For  moderate 
N 


— , the  loss  of  efficiency  for  the  randomized  block  design  is  still  very  small. 


In  general,  if  the  block  effect  accounts  for  most  of  the  unknovm  effect  g{u) , 
the  RBD  will  be  more  efficient  than  the  CBD.  More  precisely,  if 


2 

y (m  -n  ) > N,  the  s-value  of  the  RBD  is,  according  to  (3.3),  smaller  than 

i 1 


i=l 


(N-n)  N _ ^jN-n)  which  is  smaller  than  or  equal  to  the  s-value  of 

N-i  N(N-«.) 


the  CRD. 

Excunple  4.  Randomized  Cluster  Design  (RCD) . 

Let  N = nT  = pqT,  where  p is  the  size  of  the  cluster.  Divide  N 
units  into  qT  clusters  and  randomly  assign  q of  the  qt  clusters  to  each 


treatment.  For  u,  v in  the  same  cluster,  = 1;  otherwise 


IT  = (q-l)/{qT-l) 
uv 


Prom  (2.5) , 


s(n,g)  = (1 


_ 31 


qT' 


^)  ( I g^(u)  + I g(u)g(vA 
V u=l  u^v  J 

same  cluster 


The  following  calculations  are  justified  by  Lemma  1. 

(i)  qT  even.  By  choosing  ^-qT  clusters  with  all  their  g(u) 's  to  be 
1 and  the  other  jqT  clusters  with  all  their  g(u)'s  to  be  -1, 
max  s(n,g)  = + qTp(p-l))  = N . 


(ii)  qT  odd,  p 


even.  By  choosing  ^(qT-1)  clusters  with  all  their  g(u) 's 


to  be  1,  j(qT-l)  clusters  with  all  their  g(u)'s  to  be  -1  and  one  cluster 


with  half  g(u)'s  to  be  1 and  half  g(u) 's  to  be  -1, 
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I 


ii 


max  s(n,g) 
geG 


<N  + (qT-l)p(p-l)  - p) 


= (N-p)  (N-n)/(qT-l) 


(iii)  qT,  p odd.  A similar  calculation  to  (ii)  gives 

max  s(n,g)  = (N-p)  (N-n)/(qT-l) 
g£  G 

The  relative  efficiency  to  the  CRD  is 


N-1 


< 


1 

P 


for  qT  even  , 


N(qT-l)  ^ 1^ 
(N-p) (N-1)  p 


for  qT  odd,  p even  , 


qT-1  _ 
N-p  ~ p 


for  qT,  p odd 


For  large  or  moderate  p,  the  use  of  RCD  alone  is  quite  inefficient. 
However,  combining  the  RCD  with  the  RED  can  improve  the  efficiency  as  was  dis- 
cussed in  Excinple  2.  The  RCD  is  better  than  the  RBD  for  small  p and  large 
Z eind  vice  versa.  A more  precise  comparison  can  l)e  made  based  on  their 
efficiencies. 

Excuiy le  5 . Cross-over  Design  with  two  treatments. 

In  a cross-over  design  with  two  treatments,  N units  are  divided  into 

jN  bloc)ts  (1,2),  ••,  (N-1,N),  with  one  unit  receiving  a treatment  and  the 

other  unit  in  the  same  bloclc  receiving  another  treatment,  the  control . Of  the 

^N  bloclts,  ^N  blockis  are  selected  at  random  for  "treatment  and  then 

N 

control";  the  other  -7  bloc)cs  for  "control  and  then  treatment".  To  calculate 

4 

the  n 's,  it  is  sufficient  to  wor)£  out  tt,,  and  it,,,  since  for  all  i, 
uv  13  14 


’^2i+j  ,2i'+j  • 


1^13  for  j = j' 


1 or  2 


and 


’'2i+j,2i’+j'  ^^14 


for  j = 1,  j*  = 2 


or 


j = 2,  j-  = 1 
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'l  g(u)g{v)Ti 


I {g(2i+l)g(2i'+l)  + g(2i+2)g(2i'+2) } 


uv  2(N-2) 


+ I {g(2i+l)g(2i'+2)  + g(2i+2)g(2i'+l) } . 

From  Lemma  1,  we  need  only  consider  g(u)  = ± 1.  For  each  block,  there  are 
four  possible  patterns:  ++, — Let  there  be  I,  i , m,  — - 21  - m 
blocks  corresponding  to  these  four  patterns.  After  some  calculations  which 


are  omitted. 


i{n,g)  = N - - 2m  - 21)^  + (-48.  + 2)j^_2  • 


By  taking  1 = 0 and  m - — » 


max  s(r),g)  = 


The  relative  efficiency  to  the  CRD  is 


N~2 

2(N-1)  - 2 


Actually  the  s{n,g)  value  in  (3.4)  is  smaller  than  s-value  of  the  CRD, 


if  and  only  if 


-N  - 28.  - 2m 


I N 1 

1 „ ^ 2 (N-1)  - 2 
2^ 


This  result  can  be  interpreted  as  follows:  the  cross-over  design  is  superior 
to  the  CRD  if  the  number  of  + - blocks  is  substantially  larger  (or  smaller) 
than  the  number  of  - + blocks.  The  existence  of  ++  or  — blocks  will 

m2d(e  the  cross-over  design  even  more  efficient.  For  8.  = 0 (no  ++  or 

J 

blocks) , if  85%  of  the  blocks  are  +-  and  the  remaining  15%  - +,  the 


-2 


cross-over  design  ties  in  efficiency  with  the  CRO.  The  most  advantageous  case 
of  100%  + - (or  - +)  blocks  corresponds  to  the  assumption  that  cross-over 
effects  of  the  same  kind  exist  in  every  block. 


The  efficiency  comparisons  of  the  Latin  square  design  will  be  made  under 

model  (2.10)  and  the  additional  assumption  g(u,t)  = g(u)  + h(t)  and 

T 

G = {g  : |g|  £ 1,  I g(u)  =0  , u = (i,j)}  . 

i,  j=l 

.9 

Example  6.  Randomized  Latin  Square  Design. 

For  the  randomized  Latin  square  design, 

Ti  = — for  u,  V not  in  the  same  row  and  column.  By  (2.5), 
uv  T-1 


we  have 
(3.5) 


T 

s(n.g)  = I I g(ir j)g(i’ , j ' ) 

i,j=i  i^i' 


jxj* 


= ( 


1 - I - Fcrf  I + I g(io)g(i’ »j) ) • 

i,j=l  P»=j'  J 

Vi  j 


(i)  T even.  According  to  Lemma  1,  it  suffices  to  consider  the  g(u)’s 
with  half  of  them  to  be  1 and  half  of  them  to  be  -1.  Let 

m.  = nvunber  of  u*s  with  g(u)  to  be  1 in  the  i-th  row. 


number  of  u's  with  g(u)  to  be  1 in  the  j-th  column. 


m'. 

3 


n.  = T - m.  , n'.  = T - m'. 

1 13  3 


, , T-2  2 1 

s{n,g)  = illT  - 


y {(m.-n.)^  - T>  + y {(m'.  -n'.  )^  - t} 
i=l  " ^ j=l  =>  3 


is  maximized  by  taking  ‘ 

Therefore 


max  S(n»g)  = • 

geG 
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(ii)  T odd.  According  to  Lemma  1,  it  suffices  to  consider  the  g(u) 's 


12  12 

with  j (T  -1)  of  them  to  be  1/  j (T  -1)  of  them  to  be  -1  and  one  to 


be  0. 


s(n 


' fif  -"i 


is  maximized  by  taking  m^  - n^  to  be  1 for  i even  (i  ^ T - 1)  , to  be 
-1  for  i odd  (i  < T - 1)  amd  to  be  0 for  i = T . 


Therefore 


mcuc  s(n/g)  = 


T - 3T  + 4 


gcG 


T-1 


Example  7.  Systematic  Latin  Square  Design. 

For  the  systematic  Latin  square  design. 


max  s(nrg)  = max  I { ^ g(u) }' 


gcG 


geG  t?=l  uel 


for 


T even  , 


(T-l)T 


for  T odd 


The  relative  efficiency  to  the  randcanized  Latin  square  design  is  equal  to 

for  T even  , 


1 

T-1 


3 1 

T - 3T  + 4 


„3  2 T-1 

T - T 


for 


T odd 


It  is  also  worth  noting  that  the  permutations  of  treatments  only  will  give  the 


same  tt  as  the  systematic  design  and  hence  is  not  advisadale. 
uv 
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4.  Concluding  remarks. 


i 


One  reason  for  incorporating  randomization  in  experimental  design  is  to 
spread  out  more  evenly  the  risks  incurred  with  the  violations  of  the  assumed  model . 
This  idea  is  formalized  more  clearly  in  our  approach  which  consists  of  the  con- 
cepts of  neighborhood  of  model  violations,  invariance,  design  measure  and  mini- 
maxity.  But  for  designs  with  covariates,  this  approach  does  not  seem  to  work 
that  well.  The  corresponding  minimax  design  measure  depends  on  the  configura- 
tion of  the  covariates  and  is  in  general  very  hard  to  obtain.  Note  that  here 
the  invariance  technique  employed  in  Section  2 fails.  This  is  certainly  a 
very  intereoLing  problem  for  future  research. 

One  advantage  of  our  approach  lies  in  the  possibility  of  making  efficiency 
comparisons.  Due  to  Lemma  1 and  some  other  combinatorial  arguments,  it  pro- 
vides a basis  for  making  quantitative  assessments  of  various  randomization 
procedures.  The  conclusions  drawn  from  the  computations  in  Section  3 are  quite 
consistent  with  the  intuitive  grounds  on  which  the  designs  are  suggested.  Such 
a.i  idea,  i.e.  to  reduce  the  efficiency  calculations  to  simple  combinatorics  on 
the  vertices  of  the  neighborhood,  may  be  of  value  in  evaluating  other  randomiza- 
tion methods  used  in  statistics  and  related  fields. 
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